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Abstract 

In this paper, we present a new smoothing approach to solve general nonlinear 
complementarity problems. Under the Pq condition on the original problems, we 
prove some existence and convergence results . We also present an error estimate 
under a new and general monotonicity condition. The numerical tests confirm the 
efficiency of our proposed methods. 
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1 Introduction 

Consider the nonlinear complementarity problem (NCP), which is to find a solution of the 
system : 

x^O,F{x)^0 and x'^F(x) = 0, (1.1) 

where F : — > R" is a continuous function that satisfies some additional assumptions 
to be precise later. 

This problem has a number of important applications in operations research, economic 
equilibrium problems and in the engineering sciences [FP] . It has been extensively stud- 
ied and the number of proposed solution methods is enormous eg ([FMP] and references 
therein). There are almost three different classes of methods: equation-based methods 
(smoothing) , merit functions and projection-type methods. 

Our goal in this paper is to present new and very simple smoothing and approximation 
schemes to solve NCPs and to produce efficient numerical methods. These functions are 
based on penalty functions for convex programs. 

Almost all the solution methods consider at least the following important and standard 
condition on the mapping F ( monotonicity) : for any x,y ^ 0, 



[x - y) ' {F{x) - F{y)) ^ 0. 



(1.2) 
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We will assume that 

{HO) F is a (Po) -function 

to prove the convergence of our approach. This assumption is weaker than monotonicity. 
We recall the following definitions of (Pq)- and (P) -functions. We say that F : M"" — )• 
is a (Po)-function if 

max (x - y)i{Fi{x) - Fi{y)) ^0, x, y G M", 

and F is a (P)-function if 

max(x-y)i(Fi(x)-Fi(y)) >0, x,yGM". 

We start with an easy result. We define component- wise the function Fmin{x) ■= min(x, F{x)) 
with Fmin,i{x) = mm{xi,Fi{x)) for any i : l...n. 

This function possesses the same properties as F 

Lemma 1.1. Assume that F is a (Pq) (respectively (P) )-function then Fmin{x) '■= min(2;, F{x)) 
is also (Pq) (respectively (P))- function. 

Proof. Assume that F is a (Po)-fnnction. For any x,y £ M"", there exists i such that 
Xi / yi and {xt - yi){Fi{x) - Fi{y)) ^ 0. We can assume Xi > yi. Then ^ Fi{y). 

So Fi{x) ^ mm{yi, Fi{y)) and Xi ^ mm{yi, Fi{y)). Then mm{x i, Fi{x)) ^ min(yj, 
Thus {xi - yi){Fmin,i{x) - Fmin,i{y)) ^ 0. Then Fmin is a (Po)-function. The proof is 
analogue if F is a (P)-function. □ 

An other ssumption that will be useful in our approach is that the solution set is 
compact 

{HI) Z := {x ^ 0, F{x) ^ 0, x~^ F{x) = 0} is nonempty and compact. 

Remark 1.1. Under some sufficient conditions, the assumption (HI) is satisfied. Note 
that this set may be empty, for instance if —F{x) > for any x £ even when F is 
continuous and monotone. Such counter-example is easy to show, for example :F{x) = 
for X ^ and F{x) = — 1 if x ^0. 

We give in the following lemma an example of sufficient condition on the mapping F 
to insure {HI). 

Lemma 1.2. Assume that F is continuous and monotone on M". Moreover, we assume 
that: 

1. There exits y with F{y) > . 

2. There exist constants c,M>0 such that for any x, \x\i ^ M, \F{x)\ ^ c|x|i with 
c < m{F{y))/\y\ where m{F{y)) = minjPj(y). 

Let e > 0. Then := {x ^ 0,F{x) ^ 0,x'^F{x) ^ e} is compact (may be empty). 



2 THE SMOOTHING FUNCTIONS 



3 



Proof. Since F is continuous, the set is closed. To show the compactness, it is enough 
to show the boundedness of Z. The monotonicity property imphes for any x G Z^: 

x^F{y) ^ x^F{x) - y^F{x) + F{y) ^ \y\\F{x)\ + \y\\F{y)\ + e. 

Let X S and \x\i ^ M, then 



m{F{y))\x\i ^ '^XiFi{y) ^ c\y\\x\i + + e. 

i=l 

Thus 

(m(F(y)) -c|y|)|x|i ^ |y||F(y)| +e. 
Since k := m{F{y)) — c\y\ > 0, we get 

\x\i^MFiy)\ + e)\/K. 

Thus 

|x|i ^ max(M, {\y\\F{y)\ + e)/^). 
So is bounded, hence compact. □ 

Remark 1.2. All continuous monotone bounded function F satisfying the condition (1) 
also satisfies condition (2) of the lemma. Indeed there exists R > such that for any 
M > and any x such that \x\i ^ M , 

|F(x)Ki?^ ^|x|i 

Let c := -0, it enough to choose M large enough such that c < m{F{y))/\y\. 

This condition (2) allows us to consider a family of functions F satisfying some sub- 
linear growth at infinity. 

The organization of the paper is as follows. In Section 2, we define the smoothing 
functions and the approximation technique. In Section 3, we give a detailed discussion 
of the properties of the smoothing function and the approximation scheme. Section 4 
is devoted to the proof of convergence and the error estimate. Numerical examples and 
results will be reported in the last section. 



2 The smoothing functions 

We start our discussion by introducing the function 9 with the following properties (See 
[ACH, Had]). Let 9 '.M ^ {—oo, 1) be an increasing continuous function such that 9{t) < 
if t < 0, 9{0) = and 9{+oo) = 1. For instance 9^^\t) = > and 9'^^\t) = t if t < 0, 

0(2) (i) = 1 _ e-*, t G M. 

This function "detects" if i = or i > i.e. if t ^ in a "continuous way". The 
ideal function wih be the function 6'(°)(-oo) = -oo, 9^^\t) < if t < 0, 6'(°)(0) = and 
9^^\t) = 1 for t > 0. But doing so, at least a discontinuity at t = is introduced. We 
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smooth this ideal function 9^^^ by introducing Or{t) = 9{t/r) for r > 0. 
So that, 9r{0) = 0, Vr > 0, hmj,_^o+ ^rit) = 1 for aU t > and hmj._i.o+ 9r{t) = inf = 
0(— oo) < if t < 0. So hm^_j.o+ behaves essentiahy as 9^^\ Moreover, note that the 
function ^^corresponding differentiates quantitatively the positive values of t: if < ti < t2 
then < 9r{ti) < 9r{t2) and conversely. 

Now, let's consider the following equation on the one-dimensional case. Let s, t € 
be such that 

9r{s) + 9r{t) = 1. (2.3) 
For instance, let's take 9^^\ The equality (2.3) is then equivalent to 

St = 

So, when r tends to 0, we simply get st = 0. This limit case applied with s = x £ M"*" 
and t = F{x) € M"*" gives our relation xF{x) = 0. Our approximation is x^^^ F(x^'^^) = r^. 
So, for general 9, the aim of this paper is to produce, for each r € (0,ro), a solution 
X = G W with ^ such that F{x'^'''^) ^ and 

9r{x) + 9r{F{x)) = 1. (2.4) 

and to show the compactness of the set {x^^'\r € (0, tq)}. Hence by taking a subsequence 
of x^^\ we expect to converge to a solution of xF{x) = 0. The equation just above has to 
be interpreted, in the multidimensional 

0,,(xf)) + a,(F,(xW)) = l, i:l...n. 

Note that the relation (2.4) is symmetric in x and F{x) and it can be seen as a fixed 
point problem for the function Fj.^q{x) defined just below. Indeed, (2.4) is equivalent to 

X = 9^^ (1 - 9r{F{x))) = r9~^ (1 - 9{F{x)/r)) =: F,.e{x) 

and also, by symmetry of the equation (2.3) (if any), we have the relations: 

F{x) = 9~^ (1 - 9r{x)) = r9-^ (1 - 9{x/r)) . 

This fact may be of some interest for numerical methods. The speed of convergence 
to a solution can be compared for different choices of 9. 

Now, we propose another way to approximate a solution of the (NC) problem. 

Let iprit) = 1 — 9r{t). The relation (2.4) is equivalent to 

Mx) + A{F{x)) = i = Mo)- 

Hence, the relation can be written as 



2 THE SMOOTHING FUNCTIONS 



5 



Let ip = ipi = 1 — 9. thus, we have 



rip ^ 



F{x) 



For the sequel, we set 



Gr{x,y) := rip ^ 



First, we characterize solutions {x,y) of Gr{x,y) = when 9 satisfies some conditions 
independent of F. 



Let < a < 1. We say that 9 satisfies {Ha) if there exists Sa > such that, for all 

s ^ Sa, 

^ + ^9{as)^9{s). 

This condition is equivalent to 

V'(s) ^ ^^(as), S ^ Sa- 

Two examples: 

1. Let 6l(^)(t) = j^,t ^ and 9'-^\t) = t if t < (But the case t < is not useful 
in this discussion). Then ip^^\t) = ^ if t ^ and ip^^\t) = 1 - t if t < 0. The 
condition (Ha) is only satisfied with < a < 1/2 and Sa ^ T^2a- 

2. Let 6'(2)(t) = 1 - e"*, t G M. Then ip^^\t) = e"* satisfies the condition (Ha) for any 
< a < 1 with Sa = 

Note that these functions ip do not satisfies the condition {Ha) in the same range for 
a. This has some consequence for the limite of Gr{s,t) as r goes to zero (See Th.2.2 and 
Example 1 after the proof of Th.2.1). 



Theorem 2.1. Assume that for some < a < 1, the condition (Ha) is satisfied for 9. Let 
s,t € M. The two following statements are equivalent 

1. linir^o Gr{s,t) = 

2. mm{s,t) = 0. 

The statement min(s, t) = is equivalent tos = 0^tort = 0^s. This is the reason 
why we expect a solution of the (NC) problem with s = xi and t = Fi{x) by considering 
the function Gr- 



Proof. We asserts that Gr{s,t) ^ min(s,t) for any r > and s,t G M. Indeed, assume 
that s ^ t i.e. s = min(s,t). Since ip ^ 0, 

ip{s/r) ^ ip[s/r) + ip{t/r) 
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So, by the fact that ip is non-increasing, 

s/r ^ {'^{s/r) + tpit/r)) . 

Then 

Gr{s, t) ^ S. 

The assertion is proved. We now prove (1) imphes (2). Let s, t E M, we have assumed that 
\\m.r-fQGr{s,t) = thus min(s,t) ^ 0. By symmetry, we can suppose that s = min(s,t). 
We deduce the result by contradiction. Assume that s > 0. Since V' is non-increasing, 

V'(s/r) +'ip{t/r) ^ 2ip{s/r). 
For r smah enough, 2tp{s/r) ^ 'ilj{as/r) because s/r goes to infinity. Whence 

ip{s/r) +^(t/r) ^ ip{as/r). 
Again since ip is non-increasing, 

as/r ^ V""*" ii^is/r) + ip{t/r)) . 
or equivalently (r small enough), 

s a''^Gr{s,t). 

By assumption, lim.,. _j.o Gr.(s, t) = then s ^ 0. Contradiction. So s = and the implica- 
tion is proved. 

We now prove the converse. Assume s = min(s, t) = 0. Then Gr{s, t) = rip~^ (1 + ip{t/r)) 
due to V'(O) = 1. If t = 0, limr-,0 Gris,t) = limr^o rip"'^ (2) = 0. If t > 0, lim^^o ''/'(^A) = 
1 — limr^o9{t/r) = 0. Thus limr^oGr{s,t) = limr-).o rtp"^ (1) = by continuity of 
The proof is completed. 

Two examples: 

1. Let 61(1) (t) = ^ and 6l(i)(t) = t if t < 0. Then V^^H*) = if t ^ and 

ijjW(t) = 1 - i if t < 0. For s > and t > such that i + } ^ i, then 

^ , , st-r"^ 
Gi^r{s,t) 



s + t + 2r 

Note that the denominator is not zero when s,t are positive even in the case 
s = t = 0. This is interesting fact for numerical simulation. 

In that case limr_>o G'l^rC^, = Note that this is not min(s,t). We can easily 
prove that limr^.o Gi.ris, t) = if s = and t > or t = and s > 0. 

If t, s > 0, the derivative in r of Gi^ris, t) is 

-2br - 2r2 - 2a 

(6 + 2r)2 ° 

with a = st and b = s + t. So Gi^ris, t) is non-increasing in r for fixed s, t > 0. Since 
Gi,r{s-,t) ^ min(s,t) then \\m.r^oGi^r{s-,t) always exists. 
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2. Let (9(2) (t) = 1 - e"*, t G M. Then V^^H*) = e"* and 

G2,,(s,t) = -rlog(e"^/^ + e"*/^). 

for any s, f G M, 

lim G2r(s, t) = min(s, t). 

r-+0 ' 

Indeed, if s = min(s,t) then — rlog2 + s ^ G2,r{s,t) because e"'*/'' + e"*/'' ^ 2e~*/^. 
Thus 

— r log 2 + min(s, t) ^ G2,r{s, t) ^ min(s, t). 
So, we deduce the expected hmit. The assertion of Th.2.1 is clealy satisfied. 

It is an easy exercice to show that these two functions Gi^r and G2,r and there hmit 
function Gi^O)(?2,o are concave functions on (M^)^. (Pb: Is it always true for any 9?) 

Now, we focus on the case where 6 satisfies (Ha) for all a G (0, 1). 
Theorem 2.2. Assume that satisfies {Ha) is for all a G (0, 1). Then for any s,t > 0, 

lim Gr(s, t) = min(s, t). 

r—^O 

Proof. We use essentially the arguments of Th.2.1. We have seen in the course of the proof 
that Gr{s,t) ^ min{s,t) for any r > 0, s,t G M and any tp. 

Now we fixe s,t > and assume that s = min(s, t) > 0. For the lower bound, we have 
for any fixed < a < 1, since ip is non-increasing, 

ip{s/r) + ip[t/r) ^ 2'il)[s/r) ^ ip[as/r) 

for any r > such that s/r Sa- Again by monotonicity of V') 

as/r < {ip{s/r) + ip{t/r)) . 

So, for any < a < 1, there exists > such that, for any < r < r^, 

as ^ Gr{s, t). 

We deduce, for any < a < 1, 

amin(s,t) = as ^ liminf t) ^ limsupGr.(s,t) ^ min(s,t) 

We get the result with a — )■ 1. This concludes the proof. 

Note that 6^^^ doesn't satisfy the condition (Ha) for any < a < 1. We have seen 
above that lim^-i-o G.r(s, t) = {s,t > 0) which is strictly less than min(s,t). 

We denote by /(r) := Gr{s,t) with fixed s,t G M. We want to prove that Go{s,t) := 
lim^_^o+ /(^) exists under some natural condition on -0 with s,t > 0. This existence 
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is insured if /(r) is non-increasing on some interval (0,e) that is f'{r) ^ 0. We give 
a necessary and sufficient condition on tp to fulfil this last condition. Let tp as above 
{■ip = 1 — 9) and let V := {—^l''o^l'~^) x We say that V is locally sub-additive at 0+ 
if there exists r] > such that, for all < a, (3, a + 13 < rj, we have 

V{a + P) ^ Via) + V{/3). 

We can express the fact that /'(r) ^ is equivalent to this property on V. 

Theorem 2.3. Let ip = I — 9 with ^ : M — > (— oo, 1) of class such that 9' > and 
9" ^0 (i.e. ip convex). Suppose that V := {—ip' oip~^) x ip~^ is locally sub-addditive at . 
Then for any s,t > 0, Go(s,t) := lin\^o+ /(^) exists and Go(s,t) ^ min(s,t). Moreover, 
if there exists rg > such that f'^0 and rf'[r) ^ /(r) — /(O"*"), < r ^ tq then, for any 
r G (0,ro), 

- r (/(Q^) - ^(^o)) + /(o+) ^ f[r) ^ /(0+). (2.5) 

Comment: The bounds of /(r) in (2.5) give useful information for numerical simula- 
tion because of the bounds ^ /(O"^) — /(r) ^ r ^^^^ ^ r (™™(^'*)^~/(''o)) _ 



Proof Let /(r) := Gr{s,t) with s,i > and r > 0. Let H := -tp' = 9' > and 
H' = 9" ^0. So H is positive and non-increasing. A simple computation gives us 

^ ^ ^^^(s/r) + t//(t/r) 



{Hoij-^){ip{s/r)+i^{t/r))' 
The condition f'{r) ^ is equivalent to 

^H{^) + ^H{^) 



^p~'^{ip{s/r) +^{t/r)) ^ 



{Ho^-^){:^j{s/r)+i;{t/r))' 
Let a = ip{s/r) and /3 = ip{t/r). Then f'{r) ^ if and only if 

1 ^-i(a) (goV>-i)(a) + V.-i(/?) (goV'-^)(/?)) 

^ + (i?oV-i)(a + /3) 

Because H > 0, this condition is exactly the sub-additivity property 

y(a + /3) ^ y(a) + T/(/3). (2.6) 

Now assume that V is locally sub-addditive at 0^ that is there exists r] > such that 
for all < a,/3,a + /3 < T], we have V{a + /3) < V{a) + V{f3). Fix s, t > and let e > 
such that < max(^(s/e), ^(t/e)) ^ r]. This is possible because ip{+oo) = 0+ and ^ > 
{9 < 1). For r G (0,e), we have < a := ip{s/r) < rj and < /3 := ^{t/r) < rj since is 
decreasing. Hence, V{a + /3) ^ ^(a) + F(/3) which implies f'{r) ^ for any < r < e. As 
a consequence /(0+) := lim^_j.Q+ /(r) exists because /(r) is always bounded by min(s,t) 
(see Proof of Thm. 2.1). 



2 THE SMOOTHING FUNCTIONS 



9 



Now, we prove (2.5). We have assumed that 

rf'{r)^f{r)-f{0+), < r ^ vq. 

f{r)V _ rf'ir)-fir) ^ 
Let < t < ro, by integration on [t, ro] of the inequahty just above, we get 

ro t \ro t 

This can be written as 

7(0+) -/(ro) 



-t 



+ f{0)^f{t), 0<t^ro. 



This is the desired result and completes the proof. 

Two examples: In both examples below, it is easy to check that V is sub-addditive 
on (0, +oo). 

1. ^l;(^){x) = ^,x^l. So, V{y) = y - < y < 1 or V{y) = l-y,y>l. 

2. ^/;(2)(x) = e~^,x G M. So, V{y) = -ylny, < y < oo. 

The condition rf'{r) ^ /(r) — /(O) with < r small enough is satisfied by these two 
examples. Let K = H oip~^ = —il)'oil)~^. With the notations above, we have for a,/3 > 0: 

rf\r) = fir) - ^^(-)+^^(^). 

1. For V'^^^: 



K{a + f3) \a + (3j \a + P J o^A^i s + t 

In that case, we have equality: 

rf'{r)=fir)-fiO). 

2. For Since K = Id, 

sK{a)+tK{l3) sa + tf3 



K{a + P) a + (3 

Thus r/'(r) ^ /(r) - /(O). 



^ min(s,t) = /(O). 



Now, we give a necessary and sufficient condition on G{s, t) = tjj^'^ (V'(s) + V'(^)) to be 
concave in (s,t) with s,t > 0. First, note that G is concave iff Gr{s,t) = r G{s/r,t/r) is 
concave. (G = Gi with this notation). 
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Theorem 2.4. Assume that ^ : M — )• (0,+oo) satisfies ip' < 0, tp" > (i.e. convex). Let 

L(«) := -i|^^^(a), a em). 

The following statements are equivalent: 

1. G is concave in the argument {s,t). 

2. L is non-increasing and sub-additive i.e. 

L{a + /3)i^L{a) + L{/3), a,/3€VW- 

Note that ■0(M) the image of M by ^/^ is a subset of (0, +oo). 

Proof. To simplify the presentation of our results, we denote by a = il^{s) and /5 = il^{t), 
W := W{a + /3) = (V'' o V'"^)(a + /3) < 0, a + /3 € ip{R), 

and 

U := U{a + /3) = {ip" otl;-^){a + /?) > 0, a + /3 G tl;{R). 
A rather boring computation gives us, 

R := ds,sG{^,t) = [r{s)W^ - {i^'{s)fU] IW\ 
T := dt^tG{s,t) = _ (^'(t))2f7] /w3^ 

S■.= ^s,tGi■^,t) = -^P'is)^P'it)^. 

It is well-known that G is concave iff ^ 0, T ^ and i?r - 52 ^ 0. For the condition 
R ^0 (similarily for T ^ 0), we get due to the fact that < 0, 

il^"{s)W^ ^ {'4''{s)fU. 

This can written as 

_M£)1!>_E! 

That is, with s = ^'"^(a) and t = ^~^{(3), 

L{a) ^ L{a + P) 
This expresses the fact that L is non-increasing. 

For the condition RT - ^ 0, we obtain after simplifications: 

W%RT - S^) = <(s) - + i'"{t){ip'f{s)] W^U. 
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By similar manipulations as in the case R ^ 0, we can express the condition RT - S"^ 
by 

L(a + /3) L(a) +L(/3), a, /3, a + /3 G V W- 
that is L is sub-additive. The proof is completed. 

Note that T ^ iff ^ 0. Indeed, i? ^ iff L is non-increasing. Thus, by symmetry 
arguments in (s, t), T ^ iff L is non-increasing. 

An examination of the two examples above leads to the following important remark. 
We compute the functions L for the examples ^lJ^^\x) = and il^^'^^x) = and 
obtain Li(a) = —^a and L2{a) = —a. They are additive functions ! It suggests to 
find a one parameter family of function (px giving as particular cases the functions ijM^ 
and V^^^- This can be done by solving the equation RT — S"^ = 0. Indeed, additivity 
of L exactly correspond to this equation. The equation RT — = can be written as 
L(q) = -ia, A > (L is non-increasing) or equivalently 

First case: A > 1. We obtain as solution of this equation 

^ ^ ^ 1 -1 

(cix-M)^-! ^1 

for some ci > 0. 

Second case A = 1: this case has to be solved independently, we get 

for some D > 0. This case can be seen as a limit case as A — t- 1"*". The function is 
different of nature of the functions </>a, A > 1. 

The condition RT — = introduces a family of new examples of ip satisfying the 
conditions of Theorem 2.4 namely (px. This condition is exactly det (HessG) = 0. That 
is the Hessian has an eigenvalue fxi = and /LI2 ^ (since the trace of the Hessian matrix 
is R + T ^0). 

3 Convergence and error estimate 

Let Hr{x) := Gr{x, F{x)) = with Gj- defined as above. When F is a 

(i-b)-function, we can easily prove the following result. 

Lemma 3.1. Assume that F is a {PQ)-function then Hy. is {P)-function for any r > 0. 

Proof. For any x,y M", there exits i : l...n such that Xi ^ yi. We can assume that 
Xi > yi and Fi{x) ^ Fi{y). Since ip is decreasing : 'ip{xi/r) < ilj{yi/r) and '4j{Fi{x) /r) ^ 
'ip{Fi{y)/r). Consequently, ipixi/r) + ip{Fi{x)/r) < ip{yi/r) + 'ip{Fi{y)/r). Again by the 
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monotonicity of ip~^, Gr{xi, Fi{x)) > Gr{yi, Fi{y)). Hence, Hr is (i-')-function for any 
r > 0. 

So that, when the assumptions of Theorem 2.3 are satisfied, we obtain the following 
convergence result. 

Theorem 3.1. Under the assumptions of Theorem 2.3, assume that F is a {Po)-function 
and that (HI) is satisfied (The solution set of the NOP is nonempty and compact). 

(i) There exists an f > such that for any < r < r, Hr{x) = will have a unique 
solution x^'^\ the mapping r x^'''^ is continuous on (0, r), and 

(ii) Urn dist(x'^''\ Z) = 0. 
'I — s-O 

Proof. This is a dierct application of ([Sc-Ta] Theorem 4 (2)). 



Remark 3.1. Under the assumptions of Theorem 2.4, we can prove an other convergence 
result based on the smoothing thechnique disscussed in [BT]. 

When using e > 6'(i) on M+ (this is the case of example), we can prove an estimate 

for the error term ||x* — x^^^\\ between the solution x* and the approximation x^^^ under 
an assumption of monotonicity of F. 

Proposition 3.1. Assume that 6 > 9^^^ on M"*", that x* is a solution of < x*,F{x*) >= 
and x^^'^ is a nonnegative solution of Hr{x) = 0. 

(i) xf^Fi(xW) < r2 Vi = l...n 

(ii) If F satisfies the condition: 

h{\\x-y\\) < <x-y,F{x) - F{y) > 

with h : M"*" — > M such that h{0) = and there exists e > such that h : [0, e) — > [0, rj) 
is an increasing bijection. Then there exists tq > such that for any r € (0, tq), 

\\x* -x^''^\\^h~\nr^). (3.7) 

The inequality (3.7) gives the maximal behavior of the error in terms of the function h. 



Proof, (i) x*-*"^ satisfies Hr{x^'^'^) = 0, so that 

0(f^) + 0(£2^) = 1, i:l...n. 

r r 

and since > 6^^\ we obtain 

e«(£) + 0W(^)^l, 
Then, a simple calculus yields to 

xf^Fi(x(^)) < i:l...n. 
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(ii) We have 

<x* - x^'^\F{x*) - F(a;W) >= 

< x*,F{x*) > - < > - < {x'-''\F{x*) > + < > s: nr^. 

Indeed, the first term of the R-H-S is zero, the two middle terms are non-positive and the 
last term is nr^. So, by monotonicity. 

Let ro such that Tq < rj. Since /i is a bijection from [0, e) onto [0, rj) and is increasing, 
we obtain 

\\x* -x'-^'^W ^ h~\nr^). 

The proof is completed. 

4 Numerical results 

In order to verify the theoretical assertions, we present some numerical experiments for 
two smoothing approaches using the 9 functions 0^^^ and 0^^^. We first consider a simple 
2-dimensional problem which is analytically solvable where 

F{x,y) = {2-x-x^y + y'^ -2f. 

The unique optimal solution for this problem is (0, 1). 

The following figure presents the evolution of the second coordinate of the iterates for the 
two smoothing functions. The optimal solution was reached up to a tolearance of 10"^*^ in 
no more than 3 iterations. We use the updating strategy for the penalization parameter 
as precised later. The red and green points correspond respectively to the iterates of the 
smoothing method 0^^^ and 6^'^\ 




y 



Figure 4.1: Evolution of {y,F2{x,y),r). 
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We also consider a set of 10 NCP test problems with different and varying number of 
variables. 

For each test problem and each smoothing function, we use 11 different starting points: a 
vector of ones and 10 uniformly generated vectors with entries in (0, 20). 
The starting value for the smoothing parameter is fixed with respect to the theoretical 
properties as 

= max(l, / max • Fj(x°)|). 

y l<i<n 

This parameter is then updated as follows 

r^+i = min(0.1r^,(r'')^ / max |xf • Fi{x'')\) 

y l<i<n 

until the stopping rule 

max Ixf •Fi(x'')| < 10"^ 

l<j<n 

is satisfied. 



Precise descriptions of the test problems PI and P2 can be found in [HW]. P3 is a test 
problem from [LZ] while P4 and P5 can be found in [DY] , these two problems correspond 
to a non-degenerate and a degenerate examples of Kojima-Shindo NCP test problems 
[KS]. The other test problem are described in[Tin, Har]. They correspond respectively 
to the NASH-COURNOT test problems with n = 5 and n = 10 and to the HpHard test 
problem with n = 20 , n = 30 and n = 100. 

We used a standard laptop (2.5 Ghz, 2Go M) and a very simple matlab program using 
the f solve function. 

We list in the following table, the worst obtained results, n stands for the number of 
variables. Outlter is the number of outer iterations (number of changes of the smoothing 
parameter r) and Inlter corresponds to the total number of jacobian evaluations. Res. 
and Feas. correspond to the following optimality and feasibility measures 

Res. = max \xi • 

l<j<n 

and 

Feas. = II min(x, 0) 111 + || min(F(3;),0)||i. 

The results show that the second smoothing function is much more efficient and powerful. 
This was foreseeable since 



Vx>0 l-6o{x)>e''^\x)>e^^\x). 
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Pb 


size 


Outlter 


Inlter 




Res. 


Feas. 






cpu time (s) 






(^1 


02) 


(^1,^2) 




(^1, 


02) 




i) 




{01,02) 


PI 


10 


(6 


4) 


(65, 15) 


(5.6e- 


-15, 


2.5e-18) 


(l.le- 


-11, 


1.3e-10) 


(0.22,0.09) 




100 


(6 


4) 


(68, 19) 


(1.6e- 


-14, 


7.1e-22) 


(5.1e- 


-13, 


1.4e-14) 


(3.73,1.19) 




500 


(6 


4) 


(83,21) 


(5.4e- 


-12, 


1.6e-16) 


(1.9e- 


-16, 


1.4e-14) 


(31.15,89.26,) 




1000 


(6 


5) 


(77, 40) 


(3.0e- 


-14, 


3.1e-14) 


(5.1e- 


-18, 


1.8e-17) 


(388.59,201.43) 


P2 


10 


(6 


4) 


(79,23) 


(2.1e- 


-15, 


2.7e-15) 


(7.6e- 


-11, 


9.6e-19) 


(0.31,0.11) 




100 


(6 


4) 


(88,33) 


(1.84e 


-12 


,1.0e-23) 


(7.1e- 


-10, 


3.1e-14) 


(4.83,1.80) 




500 


(6 


4) 


(96,41) 


(6.5e- 


-10, 


1.9e-16) 


(6.6e- 


-09, 


1.2e-12) 


(112.14,49.59) 




1000 


(6 


5) 


(114,67) 


(l.Oe- 


-17, 


1.4e-23) 


(2.4e- 


-08, 


7.5e-18) 


(530.42,328.15) 


P3 


10 


(5 


4) 


(63, 15) 


(2.2e- 


-12, 


2.7e-21) 


(4.9e- 


-08, 


1.4e-ll) 


(0.22,0.09) 




100 


(5 


4j 


(71,18) 


(7.9e- 


-13, 


2.6e— 15) 


(9.5e- 


-08, 


4.5e-08) 


(3.10, 1.02) 




ouu 


fK 


4 j 


('70 91 

{(6, Zl) 


(^ 1/3 


-14, 


z.oe— ID ) 




-U ( , 


D.ye — uy ) 


/ 0. i i , ZD. 10 ) 




1 000 


\o 


4 j 




((\ ^p- 


-io. 


i.ze— 10 j 


(8.2e- 


-10, 


2.4e-16) 


("33^ 37 1 38 93"! 




4 


((\ 

V 




{an o^^ 
(do, zUj 


[oAe- 


1 9 




(6.1e- 


-09, 


2.8e-12) 


(U.lo, U.Uo j 




A 

4 


(6 


4) 


(^141, Zo j 


[\j.oe- 


-14, 


2.1e-23) 


(3.4e- 


-07, 


3.2e-12) 


/'n OQ n ^^^^ 
(^U.zo, U.Uo ) 


P6 


5 


(5 


3) 


(47, 17) 


(1.3e- 


-14, 


4.3e-27) 


(4.9e- 


-12, 


8.1e-17) 


(0.16,0.07) 


P7 


10 


(6 


4) 


(110,33) 


(1.2e- 


-16, 


6.1e-19) 


(l.le- 


-12, 


4.5e-14) 


(0.37,0.14) 


P8 


20 


(6 


5) 


(145,66) 


(2.9e- 


-13, 


3.7e-21) 


(0, 4.4e-12) 


(1.33,0.46) 


P9 


30 


(6 


6) 


(106,77) 


(3.7e- 


-14, 


9.6e-21) 


(4.4e- 


-08, 


6.4e-ll) 


(2.24,0.85) 


PIO 


100 


(6 


6) 


(209, 113) 


(8.5e- 


-11, 


2.1e-23) 


(2.1e- 


-07, 


1.8e-12) 


(42.09,19.12) 



Table 1: Results for 9^ and 9^ 
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